Temporal Super Resolution from a Single Quasi-periodic Image Sequence Based on Phase Registration

This paper describes a method for temporal super resolution from a single quasi-periodic image sequence. A so-called reconstructionbased method is applied to construct a one period image sequence with high frame-rate based on phase registration data in sub-frame order among multiple periods of the image sequence. First, the periodic image sequence to be reconstructed is expressed as a manifold in the parametric eigenspace of the phase. Given an input image sequence, phase registration and manifold reconstruction are alternately executed iteratively within an energy minimization framework that considers data fitness and the smoothness of both the manifold and the phase evolution. The energy minimization problem is solved through three-step coarse-to-fine procedures to avoid local minima. The experiments using both simulated and real data confirm the realization of temporal super resolution from a single image sequence.